Efficient Hand Gesture Recognition for Human-Robot Interaction
نویسندگان
چکیده
In this paper, we present an efficient and reliable deep-learning approach that allows users to communicate with robots via hand gesture recognition. Contrary other works which use external devices such as gloves [1] or joysticks [2] tele-operate robots, the proposed uses only visual information recognize user's instructions are encoded in a set of pre-defined gestures. Particularly, method consists two modules work sequentially extract 2D landmarks hands –ie. joints positions– predict based on temporal representation them. The has been validated recent state-of-the-art dataset where it outperformed methods multiple pre-processing steps optical flow semantic segmentation. Our achieves accuracy 87.5% runs at 10 frames per second. Finally, conducted real-life experiments our IVO robot validate framework during interaction process.
منابع مشابه
Hand Gesture Recognition for Human-Robot Interaction
This Master Thesis deal with the problem of visual gesture recognition. A new form of interaction to control systems has been an intensive eld of research since the actual methods do not provide much naturalism. This computer vision system recognizes not only a gesture described by the user's movement, but also the posture the hands keep during interaction. It is a general purpose system to com...
متن کاملHuman Computer Interaction Using Vision-Based Hand Gesture Recognition
With the rapid emergence of 3D applications and virtual environments in computer systems; the need for a new type of interaction device arises. This is because the traditional devices such as mouse, keyboard, and joystick become inefficient and cumbersome within these virtual environments. In other words, evolution of user interfaces shapes the change in the Human-Computer Interaction (HCI). In...
متن کاملHuman Computer Interaction Using Vision-Based Hand Gesture Recognition
With the rapid emergence of 3D applications and virtual environments in computer systems; the need for a new type of interaction device arises. This is because the traditional devices such as mouse, keyboard, and joystick become inefficient and cumbersome within these virtual environments. In other words, evolution of user interfaces shapes the change in the Human-Computer Interaction (HCI). In...
متن کاملReal-Time Hand Gesture Recognition for Human Robot Interaction
In this article a hand gesture recognition system that allows interacting with a service robot, in dynamic environments and in real-time, is proposed. The system detects hands and static gestures using cascade of boosted classifiers, and recognize dynamic gestures by computing temporal statistics of the hand’s positions and velocities, and classifying these features using a Bayes classifier. Th...
متن کاملhuman computer interaction using vision-based hand gesture recognition
with the rapid emergence of 3d applications and virtual environments in computer systems; the need for a new type of interaction device arises. this is because the traditional devices such as mouse, keyboard, and joystick become inefficient and cumbersome within these virtual environments. in other words, evolution of user interfaces shapes the change in the human-computer interaction (hci). in...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE robotics and automation letters
سال: 2022
ISSN: ['2377-3766']
DOI: https://doi.org/10.1109/lra.2022.3193251